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ABSTRACT 



This paper discusses the first year results of a screening 
procedure used to identify 92 kindergarten and first grade children who were 
at risk of developing serious emotional disturbance (SED) , and presents 
additional data on the predictive validity of the screening procedure one 
year later. The Systematic Screening for Behavior Disorders (SSBD) is a 
three- stage, multiple-gated procedure for mass screening to determine whether 
a child should be referred for psycho-educational evaluation. This study 
adapted the procedure to assess level of risk status in order to better 
target instruction, behavioral, and community-based services based on need 
and applied to a population that is at-risk in general due to a variety of 
psychosocial factors. Students were ranked by teachers and classified as 
either low, moderate, or high risk for SED based on the number of gates 
passed during the screening process. Results from the study indicate the SSBD 
procedure appears to be well suited as an instrument for the classification 
of risk status, as well as for screening children who might be referred for 
evaluation for educational and mental health services. (CR) 
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Purpose 

The purposes of this presentation were to report the first year’s results of a 
screening procedure used to identify kindergarten and first grade children who are at risk 
of developing Serious Emotional Disturbance (SED), and to present additional data on 
the predictive validity of the screening procedure one year later. The Systematic 
Screening for Behavior Disorders (SSBD) is a three-stage, multiple-gated procedure for 
mass screening to determine whether a child should be referred for psycho-educational 
evaluation (Walker and Severenson, 1992). We adapted this procedure to assess level of 
risk status in order to better target instructional, behavioral, and community-based 
services based on need and applied to a population that is at-risk in general due to a 
variety of psychosocial factors. This approach has the potential of providing more 
efficient and cost-effective means for allocating preventive services that vary in intensity 
and duration based on degree of risk. 

Research Sample 

The socio-demographic and educational characteristics of the sample are shown in 
tables 1 and 2, respectively. 

Methods 

Screening Procedure . The SSBD is designed to assess for both the presence of 
emotional and behavior problems and the effects of problem behavior on academic and 
social functioning in school. The three-stage procedure involves teacher’s nominating ten 
children who fit a behavioral profile of externalizing behavior and ten who fit a profile of 
internalizing behavior; the nominated children are then ranked on the extent to which 
they display each type of behavior (Stage 1). In Stage 2 teachers rated the five highest 
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ranked children in each group (5 internalizers and 5 extemalizers) on the Critical Events 
Checklist and the Adaptive/Maladaptive Behavior Rating Scale. Children who pass cut- 
off scores based on SSBD norms pass to Stage 3. In this stage trained professionals use 
observational measures in the classroom (Academic Engaged Time) and on the 
playground (Peer Social Behavior). Children who pass cut-off scores based on the stage 3 
SSBD norms have passed through all three gates. When this occurs, the recommended 
assessment decision is to refer the child for a comprehensive psycho-educational 
evaluation. 

In the present study we used this procedure to classify risk status as either low, 
moderate, or high based on the number of gates passed during the screening process.' 
Children who were ranked by teachers who did not pass gate 2 were classified as low 
risk. Those who passed gate 2, but not gate 3, were considered to be at moderate risk, and 
those who passed all three gates were considered to be at high risk. 

Other Measures . To assess concurrent validity of the screening procedure, we 
collected data from the Social Skills Rating (SSRS; Gresham & Elliot, 1990), Teacher 
and Parent forms, and teacher ratings on the Classroom Behavior Inventory (CBI, 
Schaefer, Edgerton, & Aronson, 1977). Apart from social skills, the SSRS also has a brief 
scale to assess externalizing, internalizing, and hyperactive behaviors and a scale which 
assesses compliance with school rules. The Parent Form measures the same social skills 
(cooperation, assertion, and self control) and Problem Behavior, but also includes a scale 
for measuring responsibility in relationships with others. The CBI broadly measures 
academic competence, temperament (extroversion and introversion), and social 
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deportment (considerateness versus hostility). Also, we collect school records data yearly 
in the project; but these data have not been analyzed at the present time. 

Results 

Screening Procedure 

Table 3 shows that 92 (14%) of the children from the initial sample of 628 
children were identified as having low risk for SED. Sixty-three (10%) of the children 
were identified as having moderate risk, and 28 (4.5%) were classified as high risk. Also, 
Table 3 shows that about 3% more children were identified as having moderate to high 
risk (n = 91, 14.5%) than would be predicted from the SSBD norms (n = 73, 11 .6%) This 
finding was predictable given that the research sample was composed of mostly ' ' 
disadvantaged children who were at risk generally due to a variety of other psycho-social 
risk factors. 

The difference between the obtained and expected frequencies for the moderate 
and high risk categories was due in part to the finding that relatively more children with 
externalizing behavior passed gate two. This might be attributed to the fact that 
externalizing behavior is more visible than internalizing behavior, or to selection bias on 
the part of teachers. However, it should be noted that the frequencies of both types of 
behavior problems were comparable among low-risk children and that the assessment 
criteria were more objective and stringent at the second and third stages of screening. 
Although the obtained frequencies for moderate and high risk extemalizers were higher 
than expected, they were comparable for internalizing children. 

Significant differences were obtained between the means for the Miami sample on 
the SSBD screening instruments and those for the SSBD normative sample for both 
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extemalizers and internal izers. This suggests that the Miami research sample displayed 
greater levels of severity with respect to risk indicators than might be expected in a 
general population sample. 

External Measures 

Table 4 shows that internalizing children in the moderate and high risk groups 
were rated on SSRS as having better social skills than externalizing children. 
Externalizing children were rated as more externalizing and hyperactive than 
internalizing children on the Problem Behavior Scale. However, teachers tended to rate 
externalizing children as more internalizing as well. Also, as table 4 shows, extemalizers 
were rated lower on the Academic Competence Scale than intemalizers. Parents who 
completed the Parent Form of the SSRS did not perceive any differences between the 
children who were classified as having internalizing or externalizing behavior problems 
by the SSBD. This was the case with me^ures of both social skills and problem 
behavior. However, this was a small sample due to significant non-response, and 83% of 
the children whose parents completed the form had been classified as at moderate risk. 
Only 5 of the high risk externalizing children were represented, along with 5 on the 
internalizing scale. 

Comparisons of externalizing and internalizing children on the CBI showed 
significant differences in the predicted direction on all scales except Creativity/Curiosity 
and Extroversion/Introversion. Externalizing children were perceived by teachers as less 
task-oriented, independent, and considerate of others and as more distractible, dependent, 
and hostile. 
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With respect to gender the SSBD identified 128 (62%) boys and 78 (38%) girls as 
having some level of risk. Relatively more boys were identified as having externalizing 
behaviors. However, a significant number of girls with internalizing and externalizing 
behaviors passed through the first stage of screening, and a proportional number of 
externalizing and internalizing girls were represented in the moderate and high risk 
groups (8% and 7%, and 2% each, respectively). Therefore, the procedures at stage 2 and 
3 appeared to be successful in identifying a significant number of boys with internalizing 
problems. 

Conclusions/Discussion 

In general, the.SSBD procedure appears to be well suited as an instrument for the 
classification of risk status, as well as for screening children who might be referredTor 
evaluation for educational and mental health services. Also, this approach to assessment 
might have significant implications for refining the definition of risk for the purpose of 
planning and implementing preventive interventions, particularly of a comprehensive 
nature. Progress in the area of primary prevention has been impeded by the lack of 
reliable methods for assessing the level of risk for specific types of disorders (Fomess, et 
al., 1996). We typically use rather gross measures that are subject to high rates of false 
positive cases. These results suggest that many of the children in our sample might 
benefit from universal interventions that target a defined population of at-risk children, 
while others might benefit to a greater extent from selective interventions that may meet 
the needs of particular subgroups of children who are at greater risk. Finally, a smaller 
group of high-risk children may require more intensive indicated interventions, given 
their more immediate needs. At the same time, the approach illustrated here has its 
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There are some technical problems assessing children as young as five years with this 
instrument, and it is not designed to detect comorbidity, which is part of the clinical 
portrait presented by high risk children. However, the Early Screening Project (ESP) 
instruments developed by Walker, Severson, and Fell (1995) to screen children aged 3-6 
using the SSBD procedure have modified and now have been published. 
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Table 1 

Sociodemographic Characteristics of Sample 



School 


Variable 




MP(n=121) 


FF (n=84) 


Total (n=205) 


Gender 










Male 


n 


72 


55 


127 




(%) 


(59) 


(65) 


(62) 


Female 


n 


49 


29 


78 




(%) 


(40) 


(34) 


(38) 


Race/Ethnicity 










African-American 


n 


82 


6 


88 


- 


(%) 


(68) 


( 7 ) 


- (43) 


Hispanic 


n 


33 


70 


103 




(%) 


(27) 


(83) 


' (50) 


White/Non-Hispanic 


n 


6 


3 


11 




(%) 


(5) 


(6) 


(5) 


Other/UK 


n 


0 


5 


3 




(%) 


(0) 


( 4 ) 


(1) 


Free/Reduced Lunch 


n 


104 


70 


174 




(%) 


(86) 


(83) 


(85) 


Home Language 










English 


n 


80 


17 


97 




(%) 


(66) 


(20) 


(47) 


Spanish 


n 


33 


62 


95 




(%) 


(27) 


(75) 


(47) 


Creole 


n 


8 


0 


8 




(%) 


( 7 ) 


(0) 


( 4 ) 


Other/UK 


n 


0 


4 


4 




(%) 


(0) 


(5) 


(2) 


Language Program 


n 


33 


50 


83 




(%) 


(27) 


(59) 


(40) 



Note: ns vary due to missing data from school records 
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Table 2 

Educational Characteristics of Sample 



School 


Variable 




MP(n=121) 


FF (n=84) 


Total (n=205) 


Age in Months 


M 


82.06 


85.81 


83.60 




SD 


10.39 


9.87 


10.32 




n 


121 


84 


205 


Number School 


M 


1.17 


1.29 


1.22 


Attended 


SD 


.40 


.69 


.54 




n 


121 


84 


205 


Absences (Days) 


M 


14.13 


13.16 


13.64 




SD 


14.59 


11.46 


11.38 




n 


86 


49 


135 


SAT Reading Total 


M 


27.00 


40.2 


30.56 


(%-ile rank) 


SD 


21.31 


30.58 


24.60 




n 


43 


16 


59 


SAT Math Total 


M 


43.78 


52.60 


46.10 


(%-ile rank) 


SD 


28.97 


34.20 


30.37 




n 


42 


15 


57 



Note: SAT available only for 1st grade, ns vary due to missing data from school records. 
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Table 3 

Results of Sampling Procedure for Risk Status Based on Total Sample in 
24 K-1 Classes (n=628) 







Predicted Sample ^ 


Obtained Sample 






Externalizing 


Internalizing 


Externalizing 


Internalizing 


Stage I ^ 












Not at Risk 


n 


120 


120 


120 


120 


At Risk Based on 
Teacher Rank 


n 


120 


120 


120 


120 


Stage II ^ 












Low Risk 


n 

%of 

total 

sample 


60 

(9.5) 


60 

(9.5) 


43 

(6.8) 


49 

(7.8) 


Stage III 












Moderate Risk 
High Risk 


n 

%of 

total 

sample 

n 

%of 

total 

sample 


25 

(3.9) 

13 

(2.1) 


25 

(3.9) 

9 

(1.4) 


39 

(6.2) 

18 

(2.9) 


24 

(3.8) 

10 

(1.6) 



’ Predicted sample based on SSBD Norms for n 628 
^ Teacher nominates and ranks 10 Students in each category (n=480) 
^ Teacher Ratings on Critical Events, Adaptive/Maladaptive Scales 
^ Observation of Peer Social Behavior and Academic Engaged Time 



Table 4 

Comparison of Externalizers and Internalizers on the SSRS Teacher Rating 
Scales 



Groups 


Variables 




Externalizers 

(0=52) 


Internalizers 

(0=28) 


P 


Social Skills 










Cooperation 


M 


6.36 


12.85 


.000 




SD 


4.18 


5.22 




Assertion 


M 


7.88 


10.53 


.02 




SD 


4.39 


5.69 




Self-Control 


M 


7.00 


12.50 


.000 




SD 


4.16 


4.74 




Total SS Score 


M 


2.1.25 


35.89 


.000 




SD 


10.97 


13.46 




Problem Behavior 










Externalizing 


M 


7.42 


2.93 


.000 




SD 


3.35 


3.55 




Internalizing 


M 


5.44 


3.89 


.04 




SD 


3.36 


2.84 




Hyperactivity 


M 


9.23 


4.39 


.000 




SD 


2.86 


3.69 




Total PB Score 


M 


22.09 


11.21 


.000 




SD 


7.70 


7.54 




Academic Competence 


M 


19.05 


25.28 


.001 


Total Score 


SD 


8.09 


8.17 






12 




Figure 2m IncrenwntMl $y$tem of prevention and intervention for the dev^opmentai 
trajectory of emotional behavioni dhorden. 
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